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Abstract. Conditional independence in a multivariate normal (or Gaussian) 
distribution is characterized by the vanishing of subdeterminants of the distri- 
bution's covariance matrix. Gaussian conditional independence models thus 
correspond to algebraic subsets of the cone of positive definite matrices. For 
statistical inference in such models it is important to know whether or not the 
model contains singularities. We study this issue in models involving up to four 
random variables. In particular, we give examples of conditional independence 
relations which, despite being probabilistically representable, yield models that 
non-trivially decompose into a finite union of several smooth submodels. 



1. Introduction 

Conditional independence (CI) is one of the most important notions of multi- 
variate statistical modelling. Many popular statistical models can be thought of 
as being defined in terms of CI constraints. For instance, the popular graphical 
models are obtained by identifying a considered set of random variables with the 
nodes of a graph and converting separation relations in the graph into CI statements 
|Lau96] . Despite the use of different graphs and separation criteria, graphical mod- 
els present only a small subset of the models that can be defined using conditional 
independence |Stu05| . It is thus of interest to explore to which extent more gen- 
eral collections of CI constraints may furnish other well-behaved statistical models. 
In this paper we pursue this problem under the assumption that the considered 
random vector is Gaussian, that is, it has a joint multivariate normal distribution. 
A precise formulation of the problem is given in Question 11.11 below. 

Let X — {X\, . . . , X m ) be a Gaussian random vector with mean vector /i and 
covariance matrix S, in symbols, X ~ A/" m (/x, £). All covariance matrices appearing 
in this paper are tacitly assumed positive definite, in which case X is also referred 
to as regular Gaussian. We denote the subvector given by an index set A C [m] := 
{1, . . . , m} by Xa. For three pairwise disjoint index sets A, B, C C [m], we write 
AALB | C to abbreviate the conditional independence of Xa and Xb given Xc- We 
use concatenation of symbols to denote unions of index sets, that is, AB = A U B, 
and make no distinction between indices and singleton index sets such that i = {i} 
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and ij = {i,j}- A general introduction to conditional independence can be found 
m [Stu05j . but since this paper is solely concerned with the Gaussian case the 
reader may also simply treat the following proposition as a definition. It states that 
conditional independence in a Gaussian random vector is an algebraic constraint 
on its covariance matrix. For a proof see for example DSS09, §3.1]. 

Proposition 1.1. Let X ~ 7V" m (/x, E) be a (regular) Gaussian random vector and 
A, B,C C [m] pairwise disjoint index sets. Then AALB \ C ij and only ij the sub- 
matrix T>ac,bc has rank equal to the cardinality oj C . Moreover, AALB \ C ij and 
only ij iJLj | C jor all i £ A and j E B. 

The proposition clarifies in particular that one may restrict attention to pair- 
wise statements iALj | C. We remark that this is also true for arbitrary (non- 
Gaussian) random vectors as it can still be shown that AALB \ C if and only if 

iALj \D for all i e A, j G B, C C D C ABC \ ij; 

see |Mat92| Lemma 3]. Since iALj \ C if and only if jALi | C, pairwise statements 
can also be represented using an index set couple ij\C that groups a two-element 
set ij C [m] and a conditioning set C C [m] \ ij. Following L M07] we refer to 
these couples as conditional independence couples. 

A conditional independence relation is a set of CI couples. We write lZ(m) for 
the maximal relation comprising all ( ™) -2™ l ~ 2 CI couples over the set [m]. A CI rela- 
tion C C IZ(m) determines a Gaussian conditional independence model, namely, the 
family of all multivariate normal distributions for which iALj \ C whenever ij\C £ C. 
Since conditional independence constrains only the covariance matrix of a Gaussian 
random vector, the Gaussian model given by C corresponds to the algebraic subset 

(1.1) V pd (C) = { E G PD m : det(E iCJC ) = for all ij\C G C } 

of the cone of positive definite m x m-matrices, here denoted by PD m . 

Standard large-sample asymptotic methodology can be applied for statistical 
inference in a Gaussian CI model if V p d{£) is a smooth manifold. However, such 
techniques may fail under the presence of singularities |Drt09) , which leads to the 
following natural question: 

Question 1.1. For which conditional independence relations C C IZ(m) is the 
associated set V p d(C) a smooth manifold? 

If m — 2 the question is trivial because the set V p d(£) is either the positive 
definite cone or the set of diagonal 2 x 2-matrices. For m = 3, smoothness can fail 
in precisely one well-known way; compare (|2.11|) and Proposition 14.21 below. 

Proposition 1.2. For m = 3, the sets V p d(C) are smooth manijolds unless the 
conditional independence relation C is equal to {ij, ij\k} jor distinct indices i,j, k. 

In this paper we will answer the question for m = 4. Note that there are 
2 24 = 16,777,2 1 6 relations on [m] — [4]. However, two relations may induce the 
same Gaussian model. For instance, V p d{C) — V p d(IC) for C = {12, 13 1 2} and 
JC = {12, 13, 12|3, 13|2}. Therefore, we begin our study of Question II. li by finding 
all Gaussian CI models for a random vector of length m = 4. In this work we build 
heavily on the work |LM07j that determines the CI r elations that are rep resentable 



in Gaussian random vector of length m < 4; see also Sim06a, Sim06b 
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Definition 1.1. A relation C is representable if there exists a covariance matrix 
£ € PD m for which det (EiCjc) — if and only if ij\C € C. 

The remainder of this paper is structured as follows. All Gaussian CI models 
for m = 4 random variables are found in Section [2 Correlation matrices and 
helpful methods from computational algebra are introduced in Section [3] and used 
to answer Question 11.11 for m = 4 in Section [4] The findings are discussed in 
Section [5l Appendix lAl lists all Gaussian CI models and implications for m = 4. 

2. Gaussian conditional independence models 

As mentioned in the introduction, there is a many-to-one relationship between 
the relations C and the sets of covariance matrices V p d (C) . In this section we explore 
this relationship and determine all Gaussian CI models on four variables. 

2.1. Complete relations and representable decomposition. Given a set 
of covariance matrices W C PD rn , we can define a relation as 

C{W) = { ij\C £ K{m) : det(E iCJC ) = for all £ S W } . 

The operator £(•) and the operator V pd (-), defined in Section [TJ are both inclusion- 
reversing. In other words, if two relations satisfy C C JC then V pd (C) 2 V p d(IC), 
and if two sets are ordered by inclusion as V C W then C(V) 2 £{W). For any 
relation £, it holds that C C C{V p d{C)). 

Definition 2.1. A relation C is complete if C = C(V p d(C)), that is, if for every 
couple ij\C ^ C there exists a covariance matrix T, € V p( j(£) with det(Eicjc) 7^ 0. 

Clearly, there is a 1:1 correspondence between models and complete relations. 
The following result provides a useful decomposition into representable pieces. 

Theorem 2.1. Every conditional independence model V p d(C) has a representable 
decomposition, that is, it can be decomposed as 

V pd (£) = V pd {£ 1 )U---UV pd (£ k ), 

where C\,...,Ck are representable relations. The decomposition can be chosen 
minimal (i.e., Ci % Cj for all i ^= j), in which case the relations C\, . . . ,Ck are 
unique up to reordering. 

Proof. Suppose not all models have a representable decomposition. Choose 
Vpd(C) to be a model that is inclusion- minimal among those without a repre- 
sentable decomposition. Enlarging the relation if necessary, we may assume that 
C is complete. Since C cannot be representable, every matrix E S V pd (C) is in 
V p d{C U {ij\C}) for some CI couple ij\C ^ C. Therefore, there exist complete 
relations JCi, . . . ,/Q, all proper supersets of C, such that 

V pd {C) = V pd {IC 1 )U---UV pd (IC l ). 

The relation C being complete, each V p d{JCj) is a proper subset of V p d(C). By the 
inclusion- minimal choice of V p d(C), each V p d(ICj) has a representable decomposi- 
tion. This, however, yields a contradiction as combining the decompositions of the 
V p d(ICj) provides a representable decomposition of V p d{C). 
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A representable decomposition can be chosen to be minimal by removing un- 
necessary components. To show uniqueness, suppose that there are two distinct 
minimal representable decompositions 

(2.1) V pd {Q = V pd (£ 1 )U---UV pd (£ k ) 
and 

(2.2) V pd (C) = V^(/Ci) U ■ • • U V pd {Ki). 
Then, for each i € [k], we have 

l 

V pd {d) = V pd (£i)nV pd (C) = \J[V pd (d)nV pd {Kj)}. 

i=i 

Since V pd {d) fl V pd {JCj) — V pd (Ci U JCj) and d is representable, it follows that 
d = Ci U ICj for some j, which implies that JCj C £j. Applying the same argument 
with the role of the two decompositions reversed, we obtain that £ s C /Cj C £j . By 
minimality, s — i, and thus, £i = /Cj. Hence, every d appears in ()2.2j) . It follows 
that k < I. Reversing again the role of the decomposition, we find that k = I and 
the fCj are just a permutation of the d- □ 

Theorem 2.2. A relation C is complete if and only if it is an intersection of repre- 
sentable relations. The representable relations can be chosen to yield a representable 
decomposition of the model V pd (C). 

Proof. Suppose a relation L is the intersection of representable relations 
Consider a CI couple ij\C £ C{V pd {C)), that is, ij\C holds for all 
covariance matrices in V pd {C). By assumption, C C d for all i € [k]. Hence, 
V pd (Ci) C y pd (£) and thus y|C G £(V^ d (£i)) for all i G [*]. But C(V pd (d)) = d 
because the representable relations d are in particular complete. It follows that 
ij\C is in each relation Ci, ■ ■ ■ ,Lk and thus also in d 

Conversely, let C be a complete relation. Let C\, ...,Ck be representable rela- 
tions that yield a representable decomposition of V pd (C) as in Theorem 12. II Since 
V pd (d) Q V pd (C) for each i G [k], we have that 

C - C(V pd (C)) C £(F pd (A)) = A- 
Hence, £ is a subset of the intersection of £i, . . . , d- Since we may deduce from 

k I k \ 

F pd (£) = (J V^d(A) c y pd f) A 

»=1 \i=l / 

that 

C £^ pd ^p|£^ C £(7 pd (£)) = £, 

we have shown that £ is the intersection of £i, . . . ,£&. □ 

Example 2.1. The following relations are derived from the marginal independence 
statements 1J123, 2J113 and 1J1234, respectively: 

£i = {12, 13, 12|3, 13j2}, 

£ 2 = {12,23, 12|3,23|1}, 

£ 3 = {12, 13, 14, 12|3, 12|4, 13|2, 13|4, 14|2, 14|3, 12|34, 13|24, 14|23}. 
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All three are representable. Since £2 H £3 is equal to £ = {12, 12|3}, the latter is a 
complete relation. However, £2 and £3 do not yield a representable decomposition 
of V p d {£) because 

V pd (£ 2 )UV pd (£ 3 ) C V pd {£). 
The minimal representable decomposition of V p d{£) is instead given by £\ and £ 2 - 

Remark 2.1. The graphical modelling literature also discusses strong complete- 
ness; see e.g. [LPMOl ]. A representable relation £ is strongly complete if the 
covariance matrices £ € V^<i(>C) with £ 7^ £({£}) form a lower-dimensional subset 
of V p d{£)- For the CI relations appearing in graphical modelling, the set V p d(£) 
typically possesses a polynomial parametrization. It follows that V p d{£) is the in- 
tersection of an irreducible algebraic variety and the cone PD m . Completeness then 
implies strong completeness by general results from algebraic geometry [CLO07] . 

2.2. All models on four variables. Call two relations £\ and £2 equivalent, 
if there exists a permutation of the indices in the ground set [to] that turns £\ into 
£2- In LM07] it is shown that for to = 4, there are 53 equivalence classes of rep- 
resentable relations. In this section, we find all Gaussian conditional independence 
models for m = 4 random variables by constructing all complete relations. The 
work in this section will lead to the proof of the following result: 

Theorem 2.3. There are 101 equivalence classes of complete relations on the set 
[m] = [4]. 

In the introduction, we stated the equality V pd (£) — V p d(IC) for the relations 
£ = {12, 13 1 2} and JC = {12, 13, 12 1 3 , 13 1 2} as an example of two relations inducing 
the same model. Alternatively, we may view this as {12, 13|2} implying {12|3, 13}. 

Definition 2.2. A (Gaussian) conditional independence implication is an ordered 
pair of disjoint CI relations (£i,£ 2 ) such that V p d{£i) = V p d(£i U £2)- We denote 
the implication as £\ => £2 and say that a relation £ satisfies £\ =>• £2, if £\ C £ 
implies that £2 C £. 

Example 2.2. Let k S [to] be distinct indices and C C [to] \ ijk. Then the 
following are Gaussian CI implications: 

(2.3) {ij\C,ik\C} =► {ij\kC,ik\jC} 

(2.4) {ij\C,ik\jC} =► {ik\C,ij\W} 

(2.5) {ij\kC,ik\jC} =► {ij\C,ik\C}. 

Implication (12. 3p follows from the last assertion in Proposition 11.11 and an implica- 
tion known as weak union that holds for all probability distributions. Implication 
(|2.4[) is referred to as contraction and also holds for all probability distributions. 
The last implication, (|2.5|) , is known as intersection and holds for many but not all 
non-Gaussian distributions. See for instance DSSOlj} §3.1] for more background. 

We now describe how to construct all complete relations by adapting the ap- 
proach taken in the construction of all representable relations in [LM07] . A key 
concept is the following notion of duality. 

Definition 2.3. The dual of a couple ij\C € lZ(m) is the couple ij\C where 
C = [to] \ ijC. The dual of a relation £ on [to] is the relation 

£ d = {ij\C : ij\Ce£} 

made up of the dual couples of the elements of £. 
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Lemma 2.1. For a positive definite matrix £ and two relations £ and K: 

(ii) £ => K if and only if £ d => JC d ; 

(iii) £ is complete if and only if £ d has this property. 

Proof, (ii) and (iii) follow readily from (i), which holds since a subdeterminant 
in an invertible matrix is zero if and only if the complementary subdeterminant in 
the matrix inverse is zero; see for instance [LM07| Lemma 1]. □ 

Any complete relation is in particular a semigaussoid, where a semigaussoid is 
defined to be a relation £ C lZ(m) that satisfies the CI implications (|2 . 3[> . (|2.4p . 
and (|2.5|) for all distinct i, j, k G [to] and G C [to] \ ijk. The separation graphoid 
associated with a simple undirected graph G with the vertex set [m] is the relation 

((G)) = { ij\C S lZ(m) : C separates i and j in G}. 

It is a semigaussoid since it is ascending and transitive, that is, 

ij\Ce(G)) =^ ij\kCe(G)) 

ij\C e ((G)) =► ik\C e ((G)) or jfc|G e ((G)) 

for any three distinct indices fe and G C [to] \ ijfc. The next two lemmas can 
be shown by slightly modifying the proofs of Lemma 2 and Lemma 3 in }LM07| . 

Lemma 2.2. The duals of semigaussoids are semigaussoids. 

Lemma 2.3. For a relation £ C TZ(m), define G to be the graph on [m] with i 
and j adjacent if and only if £ does not contain the couple ij\[m] \ ij. If £ is a 
semigaussoid then ((G)) C £. 

Call ij\C a t-couple if the cardinality of G is t. In order to find all semigaussoids 
it suffices, by Lemma 12. 2\ to consider only relations with more 2-couples than 0- 
couples. There are II unlabelled undirected graphs on 4 nodes. In light of Lemma 
12.31 we may obtain all semigaussoids by using the following search strategy (based 
on an analogous strategy in |LM07j ): 

Step 1. Starting from each of the 11 separation graphoids, add all the possible 0- 

couples and 1-couples while keeping the number of 0-couples smaller than 

the number of 2-couples. 
Step 2. For each relation obtained in this way check whether it is a semigaussoid, 

and whether it is equivalent to a previously discovered semigaussoid. 
Step 3. Find the duals of the semigaussoids discovered in Steps 1 and 2. Check 

which new semigaussoids are equivalent to earlier found semigaussoids. 

Steps 1 and 2 produce 109 semigaussoids. Figure 12.11 shows how many of 
these 109 semigaussoids are associated with each of the separation graphoids. The 
saturated relation IZ(m), given by the empty graph, is omitted from the figure. In 
step 3 of our search we obtain an additional 48 semigaussoids. Hence, there are 
109 + 48 = 157 equivalence classes of semigaussoids. 

The search for semigaussoids greatly reduces the number of relations. Among 
the 157 semigaussoids found above are the 53 representable relations determined in 
LM07 j5 but not all the remaining 104 semigaussoids are complete. For instance, 
10 semigaussoids fail to satisfy the following CI implications: 
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£7 : 4 £s : 11 £12 : 25 C 1B : 47 £53 : 10 

Figure 2.1: Counts of semigaussoids on the 4-element set by associated separation 
graphoid. The graphoids Li are labelled in reference to Table POl in Appendix [A"l 



Lemma 2.4. Any complete relation on [to] satisfies 



(2.6) {ij\C,kl\C,ik\jlC,jl\ikC} =s> {ik\C} 

(2.7) {ij\C,kl\iC,kl\jC,ij\klC} =S> {fc^|C7} 

(2.8) {y|a,jl|Jba,Ai|*C,ijfe|jiC} {i/fc|C} 

(2.9) {ii|feC s ifc|IC,ii|iC} {ij\C} 

(2.10) {ii|feC s ifc|iC,W|iC,ii|iC} {ij|C} 



for all distinct indices k, I and C C [to] \ ijkl. 

Proof. These implications are proved in |LM07[ Lemma 10]. In Section l3~3l 
we provide an alternative computer-aided proof. □ 

Proof of Theorem 12.31 There are 629 representable relations on [to] = [4], 
when treating equivalent but unequal relations as different. For each relation C 
among the remaining 94 non-representable semigaussoids find all of the 629 rep- 
resentable relations that contain it. By Theorem 12.21 C is complete if and only if 
it is equal to the intersection of these representable relations. We obtain 48 com- 
plete relations in addition to the representable ones. This yields the claimed 101 
Gaussian CI models (counting up to equivalence). □ 

All complete relations on [to] = [4] and their representable decompositions are 
listed in the appendix. One reason for complete relations to be non-representable 
is a property known as weak transitivity: For any matrix £ G PD m it holds that 

(2.11) {ij\C,ij\kC} C £({£}) =► 

{ik\C,ik\jC} C £({£}) or {jk\C,jk\iC}CC({S})- 
see for instance [DSS091 Ex. 3.1.5]. By (|2.1ip . a representable relation C satisfies 

(2.12) {ij\C,ij\kC} C L => {ik\C,ik\jC} C C or {jk\C, jk\iC} C C. 

Due to the disjunctive conclusion (|2.12[) is not a CI implication according to our 
Definition 12.21 The following theorem summarizes results about representable re- 
lations established in LM07J. 
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Theorem 2.4. A relation on [to] = [4] is representable if and only if it is a semi- 
gaussoid that satisfies implications \ 2. 6\) - [2.10\) and weak transitivity 12.12]) . 

To facilitate comparison, we remark that in [LM07] a relation obeying the 
requirements of a semigaussoid as well as the weak transitivity property was termed 
a 'gaussoid'. This motivated choosing the terminology 'semigaussoid' here. 

3. Algebraic techniques 

The conditional independence model associated with a relation C C lZ(m) cor- 
responds to the algebraic set of covariance matrices V p d (£) defined by the vanishing 
of certain 'almost-principal' determinants; recall (jl.ip . It is thus natural to begin a 
study of the geometry of V p d(C) by studying associated ideals of polynomials; see 
[CLO07] for some background. Before turning to algebraic notions however, we 
introduce correlation matrices as a means of reducing later computational effort. 

3.1. Correlation matrices. The correlation matrix R — (ry) of a (positive 
definite) covariance matrix £ = (ov,-) is the matrix with entries 



The matrix R is again positive definite, and in particular, | < 1 for all i ^ j. 

Lemma 3.1. Let R be the correlation matrix of £ G PD m , and A,B,C C [to] 
pairwise disjoint index sets. Then the conditional independence AJLB \ C holds in 
X ~ Nmip-, £) if and only if it holds inY ~ J\f m (0. R). 

Proof. Given a CI couple ij\C, we have that 

det(Ric,jc) = fj— 1 ■ det (Eicyc), 

and thus the claim follows from Proposition ll.il □ 

Example 3.1. Suppose to > 3 and let C be the relation given by the following 
pairwise CI statements that each involve three consecutive indices (modulo to): 

12|3, 23|4,...,(to- l)m|l, lm\2. 

When stated in terms of the correlation matrix R = (r^), the couple ij\k makes 
the requirement that 

det(R ikJk ) = m - r. lk r jk = 0. 

Under the relation C, we thus have = ^^+2^+1^+2 for all i € [to], where we 

take the indices modulo m. This implies that 

Ti2 = r 13 r 23 = r 13 r 24: r34: = r^^r^r^ = ■■■ = ^JJ r M+2 ^ r 12 . 

Since Ir^i^l < 1 for all i S [to], we must have r\ 2 = 0. We have thus proved the 
CI implication C =>• {12}, which generalizes the implication (|2.9|) . 

No proper subset K. C C implies {12} if m > 4. This is shown in |Sul09j by a 
suitable counterexample. We remark that the implication C {12} is also proven 
in [Sul09j using results on the primary decomposition of binomial ideals. This also 
sheds light on how the implication may fail for singular covariance matrices. 
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An important feature of this example is that it furnishes an infinite family of 
CI implications that cannot be deduced from other implications. It thus estab- 
lishes that there does not exist a finite set of CI implications, from which all other 
implications can be deduced; compare |Sul09LlStu92] . 

Correlation matrices can also be used to address the smoothness problem posed 
in Question 11.11 Let PD mi i C PD m be the set of positive definite matrices with 
ones along the diagonal. Given a relation C, we can define the set 

V cor (C) = {Re PD m>1 : det(R lCjC ) = for all ij\C eC}. 

Lemma 3.2. The model V p d(C) is a smooth manifold if and only if V cor (C) is a 
smooth manifold. 

Proof. The map that takes a positive definite matrix £ — (an) as argument 
and returns the vector of diagonal entries (an, . . . , a mm ) and the correlation matrix 
of £ is a diffeomorphism PD m — > (0, oo) m x PD m \. □ 

According to the next fact, we may pass to dual relations when studying the 
geometry of V cor (C). 

Lemma 3.3. If £ and C d are dual relations of each other, then V CO r{£) is diffeo- 
morphic to V cor (C d ). 

Proof. Let g be the map given by matrix inversion and h the map from a 
positive definite matrix to its correlation matrix. By concatenation, we obtain the 
smooth map hog: PD m ,i — > PD m .\. This map is its own inverse and, thus, 
hog: PD m .i — > PD m .i is a diffeomorphism. 

By Lemma |2~TI if R e V cor (C) then g{R) = R^ 1 € V p d{C d ), and the correlation 
matrix is in V cor (C d ) according to Lemma 13.11 Since (C d ) d = C, the 

diffeomorphism ho g is a bijection between V cor (C) and V cor (C d ). □ 

3.2. Conditional independence ideals. Let R[r] = R[r i3 : 1 < i < j < m] 
be the real polynomial ring associated with the entries r^ of a correlation matrix 
R. The algebraic geometry of the set V cor (C) is captured by the vanishing ideal 

l(V cor (C)) = {/£%] : f(R) = for a,K R £ V cor (£)} . 

However, it is generally difficult to compute this ideal, where computing refers to 
determining a finite generating set. Instead we start algebraic computations with 
the (pairwise) conditional independence ideal 

I c = (det{R iCjC ) : ij\C G C) C l{V cor {£)). 

Example 3.2. If £ = {12|3, 13|2} then Ic = (ria - ri 3 r 2 3,ri3 - ri 2 r 2 3). By a 
simple calculation using that r| 3 ^ 1 for correlation matrices, or by appealing 
to the general intersection property (|2.5p . we obtain that r\i — r\z — for all 
R € V cor (£). In fact, V cor (C) is the set of block-diagonal positive definite matrices 
with r i2 = ri3 = 0. It follows that 2(V cor (C)) = (ri 2 ,ri 3 ) ^ Ic- 

Proposition 3.1. Let C be a relation on [m] = [4]. If C is representable, then Ic 
is a radical ideal. The ideal Ic need not be radical even if C is complete. 

Proof. We verified the assertion about representable relations by computation 
of all 53 cases with the software package Singular GPS09]. The relation C = 
{12, 14|3, 14|23, 23 1 14} is an example of a complete relation with Ic not radical. □ 
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Algebraic calculations with an ideal I C l[r] directly reveal geometric structure 
of the associated complex algebraic variety 

V C (I) = { R E § m ,i(C) : f(R) = for all / € /}. 

Here, S mj i(C) is the space of complex symmetric m x m matrices with ones on the 
diagonal. Studying the complex variety will provide insight into the geometry of 
the corresponding set of correlation matrices V cor {I) but, as we will see later, care 
must be taken when making this transfer. 

For an ideal / and a polynomial h, define the saturation ideal: 

(I :h°°) = {f € K[r] : fh n € / for some n e N }. 

The variety Vc(I '■ h°°) is the smallest variety containing the set difference Vc{I) \ 
Vc((h)). When dealing with positive definite matrices that have all principal minors 
positive it holds that 

Ic C (I c : D°°) C J(V cor (C)), 

where D E M[r] is the product of all the principal minors of R. Although we have 
that (Ic '■ (1 — ^23)°°) = 3-(Va>r(£)) in Example l3.2l saturation with respect to prin- 
cipal minors need not yield the vanishing ideal X(V cor (C)) in general. This occurs 
for the relations on the left hand side of the implications in Lemma l2.4l saturation 
with respect to the principal minors does not change the ideals Ic considered in 
the proof of this lemma in Section 13.31 

If A = (dij) and B = (bij) are matrices in PD m , then the Hadamard product 
A* B = (aijbij) is a principal submatrix of the Kronecker product A® B. Hence, 
A * B is also positive definite. As pointed out in |Mat05j . it can be useful to 
consider Hadamard products of R and R n = (f^uwfj)) for permutations n on [m] 
in order to further enlarge the ideal Ic by saturation on principal minors. 

Example 3.3. If C is the relation from Example 13.11 then m is seen to be in 
Ic '■ (1 — YlTLi r i.i+2) oa and thus in the vanishing ideal T(V cor (£)). The polynomial 
1 — YiiLi r i,i+2 is a 2 x 2 minor of a Hadamard product, but of course it is also 
clearly non-zero over V cor (C) because each e (—1,1). 

However, saturation with respect to 'Hadamard product minors' does not seem 
to provide the vanishing ideal X(V cor (C)) in general; compare [Mat05j . 

3.3. Primary decomposition. A variety Vc(I) is irreducible if it cannot be 
written as a union of two proper subvarieties of § m! i(C). Every variety has an 
irreducible decomposition, 

(3.1) Vc(I) = V c (Qi)U---UV c (Q r ), 

where the components Vc(Qi) are irreducible varieties. The decomposition is unique 
up to order when it is minimal, that is, no component is contained in another; see 
[CLO07] . In that case, the Vc(Qi) are referred to as the irreducible components 
of Vc(I)- An irreducible decomposition can be computed by calculating a primary 
decomposition of the ideal /, which writes the ideal as an intersection of so-called 
primary ideals, / = n[ =1 Qi. If / is radical then / has an up to order unique minimal 
decomposition as an intersection of prime ideals Qi. Minimality means again that 
Qi % Qj for i 7^ j. See again [CLO07] for the involved algebraic notions. 



GAUSSIAN CONDITIONAL INDEPENDENCE MODELS 



11 



The computation of primary decompositions of the CI ideals Ic is in particular 
useful for investigating CI implications. We now show how to use this technique by 
giving a computer-aided proof of Lemma 12.41 

Proof of Lemma 12.41 By considering the conditional covariance matrix (or 
Schur complement) for ijkl given C, it suffices to prove the implications for the case 
C = 0. We may assume m = 4 and set i = 1, j = 2, k = 3 and I = 4. We proceed 
in reverse order, which roughly corresponds to the difficulty of the implications. 

Implication {Elty : Let C = {12|3, 23|4, 34|1, 14|2}. We need to show that the 
vanishing ideal l(V cor (C)) contains r\2- A primary decomposition of the CI ideal 
Ic, which is radical, is given by Ic = nf =1 Qj with the three components: 

Qi = (r24f*i3 - 1, •••), Qi = (r24Ti3 + !,•••), Q3 = (ri2,ri4,r23,r34). 

The claim follows as only the variety of Q 3 intersects PD^i; recall Example 13. II 

Implication \2.9jl : For the relation C = { 1 2 1 3 , 13|4, 14|2}, the ideal Ic is radical 
and has a primary decomposition with the two components: 

Ql = (r-23^24^34 - 1, •■ ■), Q2 = (ri2,ri3,ru>. 

Since t^^^ — 1 < over PD^i, the variety Vc(Qi) does not intersect PD41. 
Therefore, every matrix R = (ry) in V cor {C) has r*i2 = 0. 

Implication ifO|) : For the relation C = {12, 24|3, 34|1, 13|24}, the ideal I c is 
radical and has a primary decomposition with the two components: 

Ql = (^14^23 ~ r 14 - r 24 + 1) ^23^34 ~ T 2 4, r 13 r 14: ~ r 34 , . . .), 

Q2 = (ri2,ri3,r 2 4,r 3 4). 

Since the polynomial 

22 2 222,1 t-i 2 \ , 2 2 a 2 \ 

r 14 r 23 — r 14 — r 23 r 13 r 14 + 1 — I 1 r li) "+" r 14 r 23l 1 r 13-> 

is in Qi but positive on PZ) 4j i, the variety Vc(Qi) does not intersect PD 4i i. 

Implication (§7fy : For the relation C = {12, 34|1, 34|2, 12|34}, the ideal I c is 
radical and has a primary decomposition with the components: 

r\ I 2 2 2 2 , 2 \ 

Ql = (ri3 r 24- r 13- r 24 + r 34> r 23r24-:r34,...), 

Q2 = (ri2,ri4,r23,r34), 

Q3 = {ri2,r\a,r24,)Tte}. 

Only Qi does not already contain r^. Let R — be a positive definite matrix 
in Vc(Qi). Since 

2 2 2 2,2 2 2/2 1 \ i 2/2 1 A <- 

r 13 r 24 — r 13 — r 24 ' r 23 r 24 ~ r 13V 24 L ) + r 24l r 23 ~ i i fc Vl' 

the matrix entries satisfy ri 3 = T24 = and, thus, r3 4 = r23r 24 = 0. 

Implication Kb}) : If £ = {12, 34, 13|24, 24|13}, then J £ is radical and has a 
primary decomposition with the three components: 

Qi = (^3 - ri 4 r 2 3 - l,r 2 4 - ri 3 ,ri2,r 3 4), 

Qi = (^3 + ri 4 r 23 - l,r 24 + ri3,ri2,r 34 ), 

Q3 = (ri2,r 13 ,r24,r 34: ). 

The varieties of Qi and Q2 do not intersect PD41, which implies ri 3 = for the 
matrices in V cor {C). To see this, note that for a symmetric matrix R — (r»j) 
with ones on the diagonal, it holds that det(i?i23,i23) + (V14 + r 2 3) 2 £ Qi and 
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det(i?i23,i23) + (ru - r23) 2 € Q 2 . Hence, if R — (nj) is a real matrix in Vc(Qi) or 
Vc((?2) then it is not positive definite as det(i?i2 3) i2 3 ) = — (ru ± r2 3 ) 2 < 0. □ 

4. Singular loci of representable models 

We now return to the problem of Question If .11 for m = 4, that is, identify 
the relations £ on the index set [to] = [4] for which the set V p d(C) is a smooth 
manifold. According to Theorem 12.11 every conditional independence model is a 
union of representable models. Moreover, by Lemma 13 - 21 we may equivalently 
consider the set of correlation matrices V cor (£). The focus of this section is thus 
the geometry of V cor (C) when £ is a representable relation on [m] = [4]. 

4.1. Irreducible decomposition. The set V cor (C) associated with a rep- 
resentable relation £ cannot be further decomposed when only considering sets 
defined by CI constraints. However, there is no reason why V cor (C) should not 
further decompose in an irreducible decomposition; recall (|3.1j) . Indeed, comput- 
ing primary decompositions in Singular we observe the following (We note that 
Ic = Ijz : D°° for all representable relations £ on [m] = [4]): 

Proposition 4.1. If £ is a representable relation on [m] = [4], then the conditional 
independence ideal 1^ is a prime ideal except when £ is equivalent to one of the 
relations £15, £ 2 4, £28 and £37 listed in Table DTT71 in AvvendixTM 

We now describe the primary decompositions of the four exceptional repre- 
sentable relations. 

Example 4.1. For the representable relation C 15 = {14, 14|23, 23, 23|14}, the ideal 
7c 15 has 4 prime components: 

Qi = (n2,ri4,r23,r 3 4), Q2 = (n 3 ,ru,r23,»"24), 

Q3 = (ru,r 2 3,ri2 +r 3il ri 3 -r 24 ), Qi = (ru, r 23 , r i2 -r 34 ,r 13 +r 24 ). 

Hence, the model V cor (£15) is the union of four two-dimensional linear spaces in- 
tersected with the set of correlation matrices -PI>4,i- Only matrices R in V CO r(Qz) 
and V cor (QA) can represent £15 in the sense of C({R}) = £15. 

Example 4.2. For C 37 = {12|3, 12|4, 34|1, 34|2}, the ideal I C37 has 4 two-dimensional 
prime components: 

Qi = (ri2,r 13 ,r 2 4,r 34 ), Q 2 = (r 12 - r 34 ,r 13 - r 24 ,r 14 - ^3,^3^4 - r 34 ), 
Q3 = (ri2,r 14 ,r 23 ,r 34: ), Q 4 = (r 12 + r 34 ,r 13 + r 24 ,r 14 + r 23l r 23 r 24 - r 34 ). 

As in Example 14.11 only two components, namely, V cor (Q2) and V cor (Q 4 ), contain 
matrices that represent £37. The points of V cor (Q2) and V cor (Q 4 ) have the form 
(x,x) and (x, — x), respectively, where x is on the conditional independence surface 
depicted in Figure l4~TT a). 

Example 4.3. For £24 = {12, 23|14, 24|3}, the ideal Ic 24 has two prime compo- 
nents: 

Qi = (r 12,^23^34 - r24,ri 3 ri4r 3 4 - r\ 4 - r\ 4 + 1), Q 2 = (r 12 , r 23 , r 24 ). 

Both of the 3-dimensional components intersect the set of correlation matrices 
PD 4t \, and they intersect each other. Only V cor (Qi) contains representing matrices. 
Note that V cor (Qi) is the image of the surface in (ri 3 ,ri 4 ,r 34 )-spa,ce given by 
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V cor ({12,23|14,24|3}). 



fi3?*i4?*34 — r i4 — r 34 + 1 = under the transformation setting r 2 4 — ^"23^4 and 
leaving all other coordinates fixed. Figure l4~TT b) displays this surface. 

Example 4.4. For £ 2 $ = {13|2, 14, 23|14, 24|3}, the ideal I Cw has two 2-dimensional 
prime components: 

Qi = (ri4, ri 2 r 23 - r 13 , r 23 r 34: - r 24 , r\ 2 + rf u - 1), Q 2 = (n 3 , n 4 , r 23 , r 24 ). 

The components intersect PD± \ and each other. The representing set V cor (Qi) 
is the image of a cylinder in (r±2, r 23 , r34)-space under the transformation setting 
7'i3 = r\ 2 r 2 3 and r 24 = r 23 r 3 4 and leaving the other coordinates fixed. 

4.2. Singular points. Suppose V is an algebraic variety in the space S m .i(C) 
of complex symmetric m x m matrices with ones on the diagonal. Let X(V) be the 
ideal of polynomials vanishing on V. Choose {/i, f 2 , . . . , f?} C R[r] to be a finite 
generating set of I(V), and define J(r) to be the i x (™) Jacobian matrix with 
(k,ij) entry equal to 9/fc(r)/9ry. It can be shown that the maximum rank the 
Jacobian matrix achieves over V is equal to codim(V^) = (™) — dim(V) and, in 
particular, independent of the choice of the generating set {/i, f 2 , . . . , ft}. See for 
instance [BR90, §3] for a proof of this fact as we as Lemma T4.1[ below. 

Definition 4.1. If the variety V C § m l (C) is irreducible then a matrix R = 
{fij) G V is a singular point if the rank of J(i?) is smaller than codim(V r ). If V is 
not irreducible, then the singular points are the singular points of the irreducible 
components of V together with the points in the intersection of any two irreducible 
components. 

When presented with a set of correlation matrices V cor (C) arising from a CI 
relation C, it is useful to study the singularities of the variety Vc(Ic)- 

Lemma 4.1. The set of all points in V cor (C) that are non- singular points ofVc(Ic) 
is a smooth manifold. 
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A computational approach to the smoothness problem is thus to calculate 
the locus of singular points of Vc(Ic), using for instance the available routines 
in Singular. To determine irrelevant components that do not intersect the set 
of correlation matrices PD m i, we saturate the ideal Sc describing this singular 
locus on the product of principal minors D and then compute a primary decom- 
position of (Sc ■ D°°). If the singular locus is seen not to intersect PD m ^\ then 
the computation proves that V cor (C) is a smooth manifold. If, however, there are 
correlation matrices that are singular points of Vc(Ic), then we may not yet con- 
clude that V cor (C) is non-smooth around these points. An algebraic obstacle is 
the fact that Ic might differ from the vanishing ideal l(V cor (C)). However, even if 
Ic = T(V cor (£), then algebraic singularity of a point as specified in Definition 14.11 
need not imply that the positive definite set V cor (C) fails to be a smooth manifold 
in a neighborhood of this point. For a classical example of a real algebraic curve 
with this feature; see [BCR98, Example 3.3.12(b)]. 

On the three-element set [m] = [3], and up to equivalence, C = {12, 12|3} is the 
only relation for which V cor (C) is not a smooth manifold. The following proposition 
explains the drop in rank of the Jacobian in a generalized scenario. 

Proposition 4.2. Let f\ = det(Ric 1 ,jc\), fa = det(Ric 2 ,jc 2 ) G be the two 

determinants encoding the relation C = {ij\C\, r/|C 2 } on [m]. Let J(R) be the 
2 x (™) Jacobian matrix for fa, fa evaluated at a correlation matrix R. Then the 
maximal rank of J(R) over V cor (C) is two but this rank drops to one exactly when 
R satisfies the two conditional independence constraints 

(4.1) iJLj(Ci AC 2 )|(CinC 2 ) and jALi(Ci A C 2 )|(Ci H C 2 ). 
Here, C\ A C 2 = (C\ \ C 2 ) U (C 2 \ C\) is the symmetric difference. 

Proof. Let F = d n C 2 , C = d \ C 2 and D = C 2 \ C x . Then C, D and F 
are pairwise disjoint, and fa — det(RiCF.jCF) and fa — det(RiDF,jDF)- 

Before turning to the study of the Jacobian J(R), we note that, by Proposition 
11.11 the condition (|4.ip is equivalent to the vanishing of five Schur complements: 

(4.2) Tij - /.', ; /.', .> A'/ .., - 0, 

(4.3) Rc,i — Rc,fRf F^F,i = 0, Rc,j — Rc,fRf,f^- p ,o = 0' 

(4.4) Rd,i — RD,FRp^F^ Fi = ^5 Rdj — Rd,fRf^F^ f ,3 = ^ - 

Below we sometimes use the following shorthand for such Schur complements: 

Ra,b\f '■— Ra,b ~ Ra,fR f ^f^ fb - 

Depending on whether or not is a 'symmetric' entry of the matrix defining 
fh, the partial derivative dfh/drki is equal to the (k, I) cofactor or the sum of the 
(k, I) and (I, k) cofactors. When discussing these derivatives we always suppress 
the signs that appear when calculating a cofactor or switching two columns in a 
determinant. It is easy to check that these signs do not affect the proof. When 
writing out cofactors we use the notation \ ■ \ — det(-). 

The column of J(R) associated with contains two non-zero entries because 

(4.5) — \Rcf,cf\, = \Rdf,df\, 

are two principal minors of R. Hence, J(R) has rank either one or two. 
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Necessity of The correlations Ti C with c G C do not appear in fa. There- 

fore, for the rank of J(R) to drop to one, it is necessary that 9/i/<9r; c = for all 
c G C. This derivative is equal to 

dfx 



(4.6) 



dn, 



R C,j 
R F,j 



C,C\c 
F,C\c 



Rc,f 
Rff 



R 



FF I 



R 



CJC\c 



R, 



C.F 



R F,F R F,jC\c 



(Note that, due to our convention of not distinguishing indices and singleton index 
set, jC \c= (C U {j}) \ {c}.) The matrix Rc,jc\c — Rc,fRff R f,jC\c is obtained 
by replacing the c-th column of Rc,c\f by Rcj — Rc.fRf^Rfj- Since Rc,c\f is 
positive definite, and the last determinant in (|4.6[) is zero for all c G C, it follows 
that -Rci — Rc,f r f p R F,j — 0. In other words, the second equation in (|4.3p holds. 

Similarly, the rank of J(i?) can only be one if dfi/drj c — for all c£C. This 
implies the first equation in (|4.3|) . Treating /2 analogously, (|4.4[) also needs to hold. 

The remaining condition, (|4.2[) . is a consequence of the matrix R being in 
V cor (C). In the current amended notation, the first defining CI couple is ij\CF. By 
iterated conditioning (iterated Schur complements), this conditional independence 
holds if and only if the determinant of the conditional covariance matrix 



(4.7) 



R 



iC,jC\F 



R i,j\F 
R C,j\F 



R; 



C\F 



is zero. It follows that R 



i,j\F 



Rc,C\F 
Ri,FRp,F 



R, 



.j\F 



R 





C,C\F 



R F] = 0, which is P~2j) . 



Sufficiency of &4-l\ ): If (|4.2I) - (I4.4|) hold, many partial derivatives are zero. First, 
(|4.6p implies dfi/dr ic = df\/drj C = df2/dr it i = dfcjdrjd = for c € C and d € D. 

Second, consider two distinct indices c, d € C. The derivative dfi/dr cc i is the 
sum of two cof actors. The first cof actor is 



R 



iC\c,jC\c' 



R 



R 



F,jC\c> 



iC\c,F 

Rf.f 



\Rf,, 



R 



R, 



i,j\F 



R 



C\c,j\F Rc\c,C\c'\F 



i,C\c'\F 



= 0, 



because, by (|4.2p and (|4.3[) , the last determinant is that of a matrix with first row 
and column zero. The other cofactor is obtained by switching c and c' and also zero. 
Hence, dfi/dr cc > — 0. Similarly, dfildrdd' = for two distinct indices d,d' E D. 

Third, if c S C and / G F, then dfi/dr c f is the sum of two cofactors. Using 
(|4.2[) and (|4. 3|) . one cofactor is seen to be 

-l 



Ri,C 
Rc\c,C 

Rf,c 



F\f 



R C\c,F\f 
R F,F\f 



R C\c,j 
R F,j 



Ri,FRp fRf,c R 



R, 



C\c : C 



i,F\f 



Ri.FRj? cRp 



R, 



C\c,F\f 



R. 



C\c,F R F^F R F,3 

Rf,fRf 1 f r fj 



-1 



Rf. 



c 



R 



F,F\f 



Let Rp^RFjif) be the /-th entry of the vector i? F 1 F i?i? J . The above cofactor is 



R F } F R F,j(f) ■ 



Ri.fRf f r f.c Ri.fRf f R F,F 



R. 



F,F 

C\c,C 



R 



F,F J 

C\c,F 



Rf. 



c 



Rf,, 



= 



because (Ri t FRF 1 F R F,c, Ri,FRpF R F,F) is a linear combination of rows of the ma- 
trix (Rp^c, Rf.f)- Similarly, the other cofactor is zero and, thus, df±/dr c f = 0. 
The vanishing of df2/drdf for d G D is analogous. 



Our calculations show that only the columns of J(R) associated with 



Tjf and rff for / ^ f G F may be non-zero. To establish that J(R) has rank one 
we show that these columns are all multiples of the one for given in (|4.5[) . 
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Using the second equation in (|4.3j) . we have that 



dfx 



Rc,c 
Rf,c 



C,F\f 



drif n FtC n F,F\f 
Therefore, we obtain that 
df 



R Fj 



Or 



- — R F ] F RF,j{f) ■ 



if 



Rc,c 
Rf.c 



Rc,c 
Rf,c 

Rc,f 
Rf,f 



C,F\f 
F,F\f 



Rc^Rf^Rf,] 
Rf. fRf fRfj 



— Rj? t?R 



The derivatives dfi/drjf, dfcjdTif and dfaldr^f are similar multiples of the cor- 
responding derivatives with respect to r$j . 

The two remaining cases dfi/drff/ and df2/drff/ are again analogous, and we 
only consider the former. This derivative is the sum of two cofactors, one being 



Ri,C 

Rc,c 



R 



R 



R 
R f 



i,F\f 
C,F\f> 



Rcj 



F\f,C n F \f,F\f 



Ri,C 

Rc.c 
R f 



R 



R, 
R i 



C,F\f< 



Ri,FR FF RF. 



Rc,fR f ^ f Rf,j 
R f 



RF\f^3 RF\f,C RF\f,F\f RF\f,FR F ] F RF,j 

where (|4.2p and the second equation in (|4. 3[) were applied. Using the first equation 
in (|4.3[) . the cofactor is seen to be equal to 



R F l F RF,j{f) 



Ri,fR f f Rf,c 
Rc,c 

R F\f,C 



Rf,fR f ] f Ri,F 
Rc,F 
R F\f,F 



Rp^RFjif) ■ R FF RF,i{f) 



Rc,c 
Rf,c 

The other cofactor is obtained by switching / and /' and, thus, 
dh 



Rc,f 
Rf,f 



dr 



'If 



Rf,fRf,3 (/') ■ Rf]fRfAI) + Rf^fRfjU) ' R F ] F RF,i{f) 



dm 



We have thus proven that the rank of J(R) is one when (|4.1jl holds. 



□ 



4.3. Singular loci of representable models on four variables. Imple- 
menting the computational approach described in Section l4~2l we find the following 
result for m — 4 random variables. Note that Proposition 14.21 applies to the repre- 
sentable relations with index 29 and 32. 

Theorem 4.1. If £ is a representable relation on [m] — [4], then V cor (C) is a 
smooth manifold unless C is equivalent to one of 12 relations Ci with index i € 
{14, 15, 20, 24, 28, 29, 30, 32, 36, 37, 46, 51} listed in Table\Al\ 

Proof. Going through 53 possible cases, the computation identifies 41 models 
as smooth according to Lemma 14.11 The remaining 12 models are algebraically 
singular. Our analysis of tangent cones below shows that these 12 models are 
indeed not smooth manifolds (compare Theorem 14. 2| . □ 

We now give some more details on the singularities of the 12 relations listed in 
Theorem 14. II They can be grouped into 3 categories: 

(a) Union of smooth components: If i G {24, 28} then V cor (Ci) is the union of 
two components that are both smooth manifolds; compare Examples 14.31 and 14.41 
In each case the singular locus is simply the intersection of the two components, 
which gives the surface defined by {r\2, ^23, ^24, r^r^r^ — r\^ — r| 4 + 1) and the 



circle defined by (n 3 , r u , r 23 , r 24 , r( 2 



' 34 



1 
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If i £ {15, 37} then V CO r{C-i) is the union of four smooth components; compare 
Examples l4.ll and l4.2l The singular locus is again obtained by forming intersections 
of components. In each case the singular locus has 4 components that for i = 15 
are given by 

(712, ri4,r23,r 3 4, 7-13 -r 2 4), ('"I2,?14,7'23,r34,ri3 + r 24 ), 

(ru , ru , 7"23 , r 2 4 , r 12 - r 34 ) , (r 13 , r 14 , r 23 , r 24 , r 12 +r 34 ), 
and for i = 37 by 

(r - i2,r , i3,r24,r- 34 ,ri4 - r 23 ), (ri 2 , r i3 , r 24 , r 34 , r i4 + r 23 ), 

(r-12, ri 4 ,r 2 3, r 34 , r i3 - r 24 ), (ru, ru, r2 3 , r 34 , r i3 + r 24 ). 

ffe) Singular at identity matrix: The six models with i € {14, 20, 30, 36, 46, 51}, 
have the identity matrix as their only singular point. 

(c) Singular at almost diagonal matrices: Two cases remain. If i = 29, the 
correlation matrices that are singularities have the entries other than r 44 equal to 
zero. For i = 32, the singularities have the entries other than r3 4 equal to zero. 

Since algebraic singularity need not imply failure of smoothness, we now study 
the local geometry of the sets V cor (£) at their algebraic singularities. This local 
geometry is represented by the tangent cone, which is also related to asymptotic 
distribution theory for statistical tests |Drt09j . 

Definition 4.2. A tangent direction of V cor (C) at the correlation matrix Rq £ 
PD m i is a matrix in R mxm that is the limit of a sequence a n (R n — Rq), where 
the a n are positive reals and the R n £ V cor (C) converge to Rq. The tangent cone 
TC c{Ro) is the closed cone made up of all these tangent directions. 

The representable relations Li with i £ {15, 24, 28, 37} define unions of smooth 
manifolds. Their singularities lie in the intersection of two or more of the smooth 
components, and the tangent cone is then simply the union of the tangent spaces 
of the smooth components containing a considered singularity. 

Our strategy to determine the tangent cones of the remaining 8 singular rep- 
resentable models is again algebraic. Let the correlation matrix Rq £ PD m \ cor- 
respond to a root of the polynomial / £ R[r], Write 

L 

f(R) = Y^MR-Ro) 

h=l 

as a sum of homogeneous polynomials fh in R — Rq, where fh(t) has degree h 
and /; 7^ 0. Since f(Ro) = 0, the minimal degree I is at least one, and we define 
/iJo,min = The algebraic tangent cone of V cor (C) at Rq is the real algebraic 
variety defined by the tangent cone ideal 

(4.8) {fno,min ■ f € l(V cor (C))} c R[r]. 

The algebraic tangent cone contains the tangent cone TCc(Ro)', see e.g. [DSS09. 
§2.3]. In our setup we work with the ideal Ic C X(V cor (C)) and, thus, consider the 
cone ACc(Ro) given by the real algebraic variety of the ideal 

(4.9) Cc(Ro) = {/flo,min : / e Ic} C R[r]. 

The cone AC c(Ro) always contains the algebraic tangent cone. Therefore, we 
still have the inclusion TC c {Ro) Q AC c {Ro)- The ideal C c (Ro) in (|4~9| can be 



18 



M. DRTON AND H. XIAO 



computed using Grobner basis methods that are implemented, for instance, in the 
tangentcone command in Singular. 

Theorem 4.2. If d is one of the 8 representable relations on [m] = [4] with index 
i € {14,20,29,30,32,36,46,51}, then at all singularities Rq ofV cor (Ci) the tangent 
cone TCc(Ro) is equal to the algebraically defined cone ACc(Rq). In particular, 
the models V cor (Li) are indeed non-smooth. 

PROOF. The six models with i <E {14, 20, 30, 36, 46, 51}, have the identity ma- 
trix Id as their only singular correlation matrix. The cone ideals are 

(4.10) C ClA {Id) = C Ci6 {Id) = (r\ 4 ,r 23 ,r 12 r 24 + ri 3 r 34 ), 

(4.11) C C20 (Id) = C C51 {Id) = (r\ 4 ,r 23 ,r 12 r 24 - r 13 r 34 ), 

(4.12) Cc 30 (Id) = (ri 4 ,r 23 ,r 12 r 13 -r 24 r 34 ), 

(4.13) Cc 36 {Id) = (ri2,r 3 4,r 13 r 23 -r 14 r 24 ). 

The latter three ideals are equivalent under permutation of the indices in [m] = [4] . 

For £ 2 9, the singular points Ro = (p%) have all off-diagonal entries zero ex- 
cept for possibly p\ 4 which can be any number in (—1, 1). The cone ideal varies 
continuously with p\ 4 : 

(4.14) Cc 29 (i? ) = ( r 23 , r 13 (r 12 - p° 14 r 24 ) + r 34 (r 2 4 - P? 4 n2) )• 

The algebraic cones in this family can be transformed into each other by an invert- 
ible linear transformation. 

For £32, the singular points Rq = (Pij) have all off-diagonal entries zero except 
for possibly p® 4 which can be any number in ( — 1, 1). The cone ideal, however, does 
not depend on the value of p 34 : 

(4.15) Cc 32 (Ro) = (ri 2 ,r 13 r 23 -r 14 r 24 ). 

In each case, it can be shown that all vectors in ACci(Ro) are indeed tangent 
directions for V cor (Ci). We prove the result for i = 29; the other 7 cases are similar. 

Tangent cone of V cor (C 2 g): The ideal 

^£29 = ( r 23, -r\ 4 r 23 + r 13 r 14 r 24 + r 12 r 14 r 34 - r 12 r 13 - r 24 r 34 + r 23 ). 

Let r = (0, 0, p, 0, 0, 0) with \p\ < 1 be a singular point and i?o the corresponding- 
correlation matrix. Both TCc w (Ro) and ACc 2B {Ro) & re closed sets, and we may 
thus consider a generic direction t — (t\ 2l t\ 3 , t\ 4l t 23 , t 24 ,t 34 ) in the cone AC'c 2B (Rq) 
given by the ideal Cc 2g (Ro) in (|4.14p . We may assume pt\ 2 — t 24 ^ 0, and obtain 

fAta\ + (+ + + n + ^13(^12 - pt 2 i) 

(4.16) t = t 12 ,t 13 ,ti 4 ,0,t 24 



Let 



pt\ 2 — t 24 



t\ 2 t\ 3 t\ 4 t 24 nt\ 3 (t\ 2 — pt 24 ) — t\ 3 t\ 4 t 24 
P+ — ' — 12 



n n n n n 2 (pt\ 2 — 1 24 ) + nt\ 2 t\ 4 

It is easy to show that r n £ V cor (C 2 g) for large n; and r n — > Tq and n(r n — ro) — > t 
as n —> 00. Thus, t e TCc 29 [Ro), and it follows that TCc 2g (Ro) = AC C2g (Ro)- □ 



GAUSSIAN CONDITIONAL INDEPENDENCE MODELS 



19 



5. Conclusion 

We conclude by pointing out some interesting features of our computational 
results for m = 4. First, the model associated with a representable relation need 
not correspond to an irreducible variety. It can be a union of several distinct 
irreducible components that all intersect the cone of positive definite matrices; see 
Examples 14.31 and 14.41 in which the components all have the same dimension. 

Second, Examples 14 . 31 and 14 . 41 also provide a negative answer to Question 7.11 in 
DSS09 . This question asked whether Gaussian conditional independence models 
that are smooth locally at the identity matrix are smooth manifolds. The singular 
loci of these examples, however, do not contain the identity matrix. All other 
singular models are singular at the identity matrix, and in fact, the identity matrix 
is often the only singularity (recall Section 14.3ft . 

Our final comment is based on the observation that Gaussian conditional inde- 
pendence models for m = 3 variables are smooth except for the model given by ij 
and ij\k, and that singular models can arise more generally when combining two 
CI couples ij\C and ij\D (recall Proposition 14. 2j) . This observation may lead one 
to guess that if a complete relation C does not contain two CI couples ij\C and 
ij \D that repeat the pair ij, then the model V p d(£) is smooth. Unfortunately, this 
is false, again because of Examples 14.31 and 14.41 

Appendix A. Lists of relations and CI implications 

In this appendix we provide encyclopedic information about conditional inde- 
pendence of four Gaussian random variables. This comprehends the listing of all 
representable and complete relations, as well as all Gaussian CI implications. 

A.l. Representable and complete relations. Counting up to equivalence, 
there are 53 representable relations on four variables. They are listed in Table 
below, where the symbol * is used to denote all possible conditioning sets. With 
this convention, the symbol 12|*, for instance, expands to {12, 12 1 3 , 12|4, 12|34}. In 
the table we indicate whether the model is singular and give the equivalent dual of 
each representable relation. We include a permutation of the indices that provides 
the equivalence. Using cycle notation, an empty entry stands for the identity. 

The remaining 101 — 53 = 48 equivalence classes of complete but not repre- 
sentable relations are listed in Table [A~2l Each cell in the second column provides, 
row-by-row, the representable relations in the minimal representable decomposition 
from Theorem 12. II Their intersection gives the considered complete relation. For 
each representable relation in the table cell, we also provide, in the third column, 
the label of its equivalent representable relation in Table IA.1I and the permutation 
that transforms the equivalent relation to the current one. 

In the introduction we mentioned that graphical models are smooth CI models. 
Over 4 nodes, there are 11 unlabellcd undirected graphs. Figure l2~T1 from Section l2~2l 
shows for each of the 10 non-empty graphs the corresponding representable relation 
from Table rA~Tl Up to equivalence, there are 10 additional graphical models asso- 
ciated with acyclic digraphs on 4 nodes. The 10 digraphs are shown in Figure |A. II 
together with the corresponding representable relations. We remark that the repre- 
sentable relations £35, £40, £44, C48 & n d £49 determine graphical models based on 
mixed graphs with directed and bi-directed edges. The corresponding 5 graphs are 
shown in |RS03, Fig. 10]. Two further representable relations correspond to chain 
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graphs: £13 is given by the so-called LWF interpretation of the graph in jAMPOlj 
Fig. 1] and £43 by the AMP interpretation of the graph in |AMP01|. Fig. 8(a)]. 

A. 2. All CI implications for four variables. Although not pointed out 
explicitly, |LM07j have proved the following result via Theorem 12.41 

Theorem A.l. For m = 4 variables, all the Gaussian CI implications follow from 
the implications li2.3\ )- ^2.10\) and the weak transitivity property in \2.1lXi . 

Due to its disjunctive conclusion, the weak transitivity property is not a CI 
implication in the sense of our strict Definition 12.21 A natural problem is thus to 
find a set of CI implications in the sense of this definition, from which all other 
such CI implications can be deduced. 

Recall the last step of the search of complete relations in Section [21 which 
treats 94 semigaussoids that satisfy (|2 . 6[) - (12 . 10[) but arc not representable. Of these, 
46 are not complete and each yield new CI implications. Namely, if C is such 
a semi-gaussoid and C the smallest complete relation containing C, then C 
(£\£). After a careful check, we find that the following 13 CI implications together 
with their duals generate all of the 46 CI implications given by the non-complete 
semigaussoids: 



(A.l) {23|4,23|14,24|1,34|1} => {23, 23|1, 24|13, 34|12}, 

(A.2) {23,23|1,24|1,34|1} {23|4, 23|14, 24|13, 34|12}, 

(A.3) {14|2,14|3,14|23,23|14} {14}, 

(A.4) {14, 14|2,14|23,23|14} =S> {14|3}, 

(A.5) {14, 14|2,14|3,23|14} {14|23}, 

(A.6) {14, 14|23,23|1,23|14} {14|2, 14|3}, 

(A.7) {14|2, 14|3,23|1,23|14} {14, 14|23}, 

(A.8) {12,14|3, 14|23,23|14} => {12|3, 12|4, 12|34, 23|4}, 

(A.9) {12,14|3,23|4,23|14} {12|3, 12|4, 12|34, 14|23}, 

(A.10) {12|3, 14|2,23|4,23|14} {12, 12|4, 12|34, 14}, 

(A.ll) {12|3,14,14|2,23|14} => {12, 12|4, 12|34, 23|4}, 

(A.12) {14|2,23|1,23|4,23|14} {23}, 

(A.13) {14|2,23,23|1,23|14} =^ {23|4}. 



Although the CI implications (|A.1[) - (|A. 13|) are written with concrete choices of 
indices, they should be viewed as representing an equivalence class, that is, as the 
class of implications that can be obtained by a permutation of the indices. 

Theorem A.2. A relation on [m] — [4] is complete if and only if it satisfies the 
CI implications iO)- iTOfl) . (O)- EOB and the duals of iCO)- iCP3)) . 

Corollary A.l. All Gaussian CI implications for 4 variables can be deduced from 
W^j- Wllk) . TAJ\) - TA1B and the duals of (Aj$) - $AJ$ . 

We conclude by demonstrating how to prove some of the implications in (|A.1|) - 
(|A.13|) by using the weak transitivity property. 

Proof of (|A.1|) . Suppose the CI statements in the relation on the left hand 
side are satisfied. By ([23|), {24|1, 34|1} =*> {24|13, 34|12}. By (23J|, {24|1, 23|41} 
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{23|1, 24|13}. Hence, it remains to show that 23 is implied. By weak transitivity 
applied to {23|4, 23 1 14} , we conclude that 12|4 or 13|4 hold. There are two cases: 

(i) Suppose that 12|4 holds. Then {12|4, 24|1} => {12,24} by the 'intersec- 
tion' implication in Applying again, {12,23|1} {23}. 

(ii) By symmetry, we reach the conclusion that 23 holds also when starting 
from 13|4 instead of 12|4. □ 

Proof of (IA.6I) . In view of (|A.4|) (interchange 2 and 3 when necessary), we 
only need to show 14|2 or 14|3 must hold when the CI statements on the left hand 
side hold. From weak transitivity applied to {23|1, 23|14}, two cases arise: 

(i) If 24|1 holds then we may apply to obtain {24|1,23|1} => {24|13}. 
By {24|13, 14|23} =>■ {14|3}. 

(ii) If 34|1 holds then we may conclude, by symmetry, that 14|2 holds. □ 

Proof of (|A.9|) . It suffices to show that 12 13 and 12|4 are implied. Applying 
weak transitivity to {23|4, 23 1 14} we can consider the two cases 12|4 or 13 14: 

(i) If 13|4 holds then by {13|4, 14|3} =*> {13, 14}. Using ([2"3|l . we can 
conclude {12, 13, 14} => {12|3, 12|4}. 

(ii) If 12 14 holds then we can apply weak transitivity to {12, 12 14} . The two 
subcases are: 

(ii-a) If 24 holds then, by J53J), {24, 23|4} =>■ {23} and, by l[2~3]) . {12, 24} => 

{12]4}. Another application of (23]) yields {12,23} =>■ {12|3}. 
(ii-b) If 14 holds then we may apply weak transitivity to {14, 14| 3} and 
split into two further subcases: 
(ii-bl) If 13 holds, then flS^) yields {12, 13} => {12|3}. 
(ii-b2) If 34 holds, then JH]) yields {34, 23|4} => {23}. Applying 

we conclude {12, 23} => {12|3}. □ 

PROOF of (lA~T0l) . Since {12, 14|2} {14, 12)4} by (2T|) and {12|4, 23|4} => 
{12|34} by (|2.3|) . it suffices to show that 12 holds under the assumed CI statements 
on the left hand side. Apply weak transitivity to {23|4, 23 1 14} to obtain two cases: 

(i) If 12|4 holds then $2J$ yields {12|4, 14|2} => {12}. 

(ii) If 13|4 holds then (H) yields {13|4, 14|2, 12|3} {12}. □ 
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Table A.l: All representable relations on four variables, up to equivalence. 



i 


hAements or Li 


Singular 


Dual 




i 
1 


1 1 j, 1 9 1 j, 99 1 j, OA 9/1 1 j, 

lz|*, lo|*, X41| * , zo|#, z4|*, o4|* 




1 




o 
Z 


1 o 1 OQIj, 9/1 Ij, 9/1l^ 
lo *, 14 *, ZO *, ^^|*, o4|* 




z 




Q 

o 


1/1l^ 99l1 99l1 A 0/11.1, Q/ll^. 
14|*, Zo|l, Zo|14, z4|*, o4|* 




9Q 
OO 




A 

4 


lo|*, l_4t | * , zo|* z4|* 




A 

4 







1 /1 1 ^ OA \ 9/1 1 ^ 
14|*, z4|*, o4|* 












99l1 9911/1 9/lM O/lh Q 9/1l1 9/1119 
zo 1, zo|14, z4 1, z4|lo, o4 1, o4|lz 




90 

oy 




( 

Q 

o 


1/llO 1 A I 99 99 1 1 99 1 1 /I 9 /I 1 1 9 /I I 9 9/1 1 1 9 

14|z, 14|zo, zo 1, zo|14, o4 1, o4|z, o4|lz 

99l 1 991 1 /I 9/1 M 9/1 119 
ZO|l, Z0|14, 04 1, 04|1Z 




a n 
4U 

A 1 

41 






y 


99l1 0911/1 0/1 1 Q 9/ll1 9/1110 
zo|l, zo|14, z4|o, o4|l, o4|lz 




A 
4z 




1 n 

1U 


10 10l9 09 09l1 0911/1 9/ll1 9/1119 
Iz, l-^|o, zo, zo|l, zo|14, o4|l, o4|lz 




1 n 

1U 


(14) (23) 




09l1 0911/1 OA 9/ll1 9/1119 
zo|l, zo|14, z4, o4jl, o4|lZ 




A 9 
4o 




"1 

Iz 


1 A 1 99 99 1 1 A 
14|zo, zo|14 




A A 
44 




1 9 
lo 


19 1/1 199 99ll A 
LZ 1 14|zo, Zo|14 




A K 
40 




1 A 
14 


1/1 1/1 199 99ll A 
14, 14|Zo, Zo|14 


/ 

V 


ACK 
40 




1 K 
10 


1/1 1/1 199 99 99ll A 
14, 14|zo, Zo, zo|14 


/ 

V 


1 K 
10 






99l 1 /I 
zo| 14 




A7 
4 ( 




1 I 


1 91 9 99 1 1 A 
lz|o, Zo| 14 




4o 




lo 


1 A 19 99l 1 A 
14|Z, zo|14 




/IO 

4y 




1 o 

iy 


1 91 9 1 A 19 99 1 1 /l 
lz|o, 14|z, zo|14 




ou 




9fl 
ZU 


1/119 1/119 9911/1 
14|Z, 14|o, Zo|14 


/ 

V 


^1 
01 




1 


1 olo 00 I 1 /I O /I I 

lo|2, 23|14, 24|3 




52 




00 
zz 


1 9 99l 1 A 
Iz, zo|14 




99 

zz 


(13j 


zo 


19 1/119 9911/1 
IZ, 14|o, Zo| 14 




9^. 

zO 


(16) 


0/1 
z4 


1 9 99l 1/1 9/1 19 
Iz, zo| 14, z4|o 


/ 

V 


9/1 
z4 


(16) 


0^ 
zO 


19 99l 1 /I 9/1 19 
IZ, Zo| 14, o4|Z 




99 
zo 


(16) 


9£ 
ZO 


1 A 991 1 A 
14, zo|14 




0f\ 
zO 


(Vl)(6^) 


07 
Z I 


1 91 9 1/1 99 1 1 A 
lz|o, 14, ZO| 14 




97 
z i 


(12)(64) 


28 


13|2, 14, 23|14, 24|3 


/ 


28 


(13)(24) 


29 


23, 23|14 


/ 


29 




30 


14|2, 23, 23|14 


/ 


30 


(23) 


31 


12|3 




31 


(34) 


32 


12|3, 12|4 


/ 


32 




33 


12|3, 13|4 




33 


(23) 


34 


12|3, 14|2, 23|4 




34 


(12)(34) 


35 


12|3, 34|1 




35 


(12)(34) 


36 


12 3, 12 4, 34|1 


/ 


36 


(12) 


37 


12|3, 12|4, 34|1, 34|2 


/ 


37 




38 


14|*, 23, 23|4, 24|*, 34|* 




3 





Continued on next page 
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i 


Elements of d 


Singular Dual 


39 


23, 23|4, 24, 24|3, 34, 34|2 


6 


40 


14, 14 3, 23, 23 4, 34, 34 1, 34 2 


7 


41 


23, 23 4, 34, 34 2 


8 


42 


23, 23 4, 24 1, 34, 34 2 


9 


43 


23, 23 4, 24 13, 34, 34 2 


11 


44 


14, 23 


12 




1Z 04, l^t, zo 


±0 


46 


14, 14|23, 23 


/ 14 


47 


23 


16 


48 


12|4, 23 


17 


49 


14|3, 23 


18 


50 


12|4, 14|3, 23 


19 


51 


14 2, 14 3, 23 


/ 20 


52 


13|4, 23, 24|1 


21 


53 





53 



Table A. 2: All complete non-representable relations on four variables, up to 
equivalence. 



i Representable decomposition of d Equivalence class 



54 


13 


*, 14 


*, 23 


*, 24|*, 34|* 


2 






12 


*, 14 


*, 23 


*, 24 *, 34 * 


2 


(234) 


55 


13 


*, 23 


*, 24 


1, 24|13, 34|* 


3 


(34) 




12 


*, 23 


*, 24 


*, 34 1, 34|12 


3 


(234) 


56 


13 


*, 14 


*, 23 


*, 24|*, 34|* 


2 






12 


*, 23 


*, 24 


*, 34 1, 34 12 


3 


(234) 


57 


13 


*, 14 


*, 23 


*, 24|*, 34|* 


2 






12 


*, 14 


*, 23 


*, 24 *, 34 * 


2 


(234) 




12 


*, 13 


*, 23 


*, 24 *, 34 * 


2 


(24) 


58 


14 


*, 23 


1, 23 


14, 24|*, 34|* 


3 






13 


*, 14 


2, 14 


23, 23 *, 34 * 


3 


(1243) 




12 


*, 14 


*, 23 


*, 34|* 


4 


(234) 


59 


14 


*, 23 


1, 23 


14, 24|*, 34|* 


3 






12 


*, 14 


*, 23 


*, 34|* 


4 


(234) 


60 


13 


*, 14 


*, 23 


*, 24|*, 34|* 


2 






12 


*, 14 


*, 23 


*, 34 1* 


4 


(234) 


61 


13 


*, 23 


*, 34 


* 


5 


(34) 




12 


4, 12 


34, 23|1, 23|4, 23|14, 34|1, 34|12 


7 


(24) 


62 


13 


*, 23 


*, 34 


* 


5 


(34) 




12, 12|3, 23, 23|1, 23|14, 34|1, 34|12 


10 





Continued on next page 
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i 


Rcpresentablc decomposition of Hi 


Equivalence class 


D3 


lz|*, zo|*, z4|*, o4|l, o4|lz 


3 


(234) 




1 Ol^ 1/11^. OQIj- Q/1 Ij, 
1Z|*, 14|*, zo|*, 04|* 


4 


(234) 




1QL OO L. O/l L, 
lu *, ZO 04PP 


5 


(34) 


04 


19l^ OQlo. O/ll^, Q/lll Q/lllO 
1Z|*, ZO|*, Z4|*, 04|1, 04|1Z 


3 


(234) 




1 Ol-i. 1 /1 1^ OQl.*. Q/1 Ij, 
1Z PP, 14 PP, Zo PP, 04|* 


4 


(234) 




19 191^ I^U 9**l* '\A\~k 

1Z, ±Z 0, IO T; ZO 04PP 


38 


(143) 


DO 


"\A\-i, 9Ql1 9QM/1 9/ll^ Q/ll^. 
14|*, Zojl, Zo|14, Z4|*, o4|* 


3 






191* 9^1* 9/LU ^t/lll ^/Ll19 

1Z PP, ZO *j 04 1, 04 1Z 


3 


(234) 




1^1* 9^1* 9/1 9/Ll'3 ^4 U 
10 *, ZO PP, Z^, Z4 O) 04PP 


38 


(34) 


DD 


IOL OQl* 9/1 1* Q/lll Q/1 ll 9 
1ZPP, ZOPP, Z4PP, 04|1, 04|1Z 


3 


(234) 




1Ql-i- 9Ql^ 9/1 0/1 1 Q Q/ilj- 
loPP, Zo pp, Z4, Z4|o, o4pp 


38 


(34) 


I 


1 9 1 ^ 1 /1 1 ^ 9 Q 1 ^ Q /I 1 ^ 
1Z|*, 14|*, zo|*, o4|* 


4 


(234) 




1 1 . OQ 1 . A 1 . 
lo|*, Zo|*, o4|* 


5 


(34) 


Do 


1/llO 1/llOQ OQll OQM/1 Q/lM Q/llO Q/lllO 

14|Z, 14|Zo, zojl, Zo|14, o4|l, o4|Z, o4|lZ 


7 






IQlO IQl/1 1QI0/1 1/ll9 1/1l0Q OQl/1 OQ 1 1 /I 
lo|Z, lo|4, lo|Z4, 14|Z, 14|Zo, Zo|4, Z0|14 


7 


(1243) 


by 


lo|*, 14|*, Zo|*, Z4|* 


4 






1/ll9 1/llOQ OQll OQh/1 Q/1l1 Q/llO Q/lllO 
14|Z, 14|Zo, Zojl, Zo|14, o4|l, o4|Z, 04|1Z 


7 




IV 


1 /| I . OQ I 1 OQ I 1 /I O/l 1 1 Q A \ ^ 

14|*, Zo 1, Zo|14, Z4|#, o4|* 


3 






101^. 1 Q 1 j, OQ 1 /I OQ 1 1 /I 

1Z|*, lo|*, J-4|*, Zo|4, Zo|14 


3 


(14)(23) 




1 1 ^, l/ll^. OQ 1 ^ 0/1 1 ^ 
lo|*, J-4|*, zo|*, Z4|* 


4 






1 91* 1 /List 9^1* ^41* 
1ZPP, l^PK, ZO *, 04* 


4 


(234) 


71 


i"A\~^ 9Ql1 9QI1/1 9/ll^ ^/ll^ 
14|*, Zojl, Zo|14, Z4|*, o4|* 


3 






1 q I 1 /i | j, ool 0, O/l 1^, 
lo|* 7 -L4|*, Zo|* 7 Z4|* 


4 






191* 1Al* 9^U ^/lU 
1ZPP, IftPP, ZO *, 04* 


4 


(234) 


70 


1Q|j, 1/IIj, OQIj, O/IIj, 

lo|*, 14|* ; Zo|*, Z4|* 


4 






101^. i/ilj, oqIj, Q/IIj, 
1Z|*, 14|*, Zo|*, o4|* 


4 


(234) 


7'j 
/ O 


OQll OQM/l Q/lM Q/lllO 

zo 1, Zo|14, o4 1, o4|lZ 


8 






0Qh oQh/i o/ih o/ih q 

Zo 1, zo|14, Z4 1, Z4|lo 


8 


(243) 


7/1 
/ 4 


1/1l0 1 A I OQ OQll OQM/l Q/lM Q/llO Q/lllO 

14|Z, 14|Zo, 1 ? Zo|14, o4|l, o4|Z, o4|lZ 


7 






1/1 1/1IO OQll OQl 1 A O/l O/lM O/l 1 1 Q 

14, 14|Z, Zo 1, Zo|14, Z4, Z4|l, Z4|lo 


10 


(243) 


7£ 
/O 


1 O 1 1 OQl , O/l 1 1 

1Z|*, Zo|*, Z4|* 


5 


(234) 




10lQ 101/1 IOlQ/1 1/llQ 1 A 1 OQ OQl/1 OQl1/l 

lZ|o, 1Z|4, 1Z|o4, 14|o, 14|Zo, Zo|4, Zo|14 


7 


(13)(24) 




10lQ 1QI/1 1 Ql O/l OQl/1 OQl 1 /I 

lZ|o, lo|4:, lo|Z4, Zo|4, Zo|14 


9 


(142) 


7R 
/ D 


1 Q I ^ OQ I ^ Q/l I ^ 
10|*, zo|*, o4|* 


5 


(34) 




12 *, 23 *, 24 1* 


5 


(234) 




12 4, 12 34, 23|1, 23|4, 23|14, 34|1, 34|12 


7 


(24) 




13 4, 13 24, 23 1, 23 4, 23 14, 24 1, 24 13 


7 


(243) 


77 


12|*, 23|*, 24|* 


5 


(234) 




12, 12|3, 23, 23|1, 23|14, 34|1, 34|12 


10 






12, 12 3, 13, 13 2, 23 14 


43 


(1423) 


78 


12|*, 23|*, 24|* 


5 


(234) 




12, 12|4, 12|34, 14, 14|2, 23|4, 23|14 


10 


(1432) 




12, 13 4, 13 24, 23|4, 23|14 


11 


(142) 
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i 


Rcpresentablc decomposition of d 


Equivalence class 


79 


12|*, 13|*, 14|*, 23|4, 23|14 


3 


(14)(23) 




12 *, 14 *, 23 *, 34 j* 


4 


(234) 




12 *, 23 *, 24 j* 


5 


(234) 




12, 12|3, 13|*, 23|*, 34|* 


38 


(143) 


80 


14, 14|2, 23|1, 23|14, 24, 24|1, 24| 13 


10 


(243) 




12, 12 4, 12 34, 14, 14|2, 23 4, 23 14 


10 


(1432) 


81 


14, 14)3, 23|1, 23|14, 34, 34|1, 34|12 


10 


(24) 




14, 14 2, 23 1, 23 14, 24, 24 1, 24 13 


10 


(243) 


82 


12|*, 14|*, 23|*, 34|* 


4 


(234) 




14, 14|2, 23|1, 23|14, 24, 24|1, 24| 13 


10 


(243) 


83 


13|*, 23|*, 34|* 


5 


(34) 




12 *, 23 *, 24 * 


5 


(234) 




12, 12|3, 23, 23|1, 23|14, 34|1, 34|12 


10 






13, 13 2, 23, 23 1, 23 14, 24 1, 24 13 


10 


(23) 


84 


13 1 14|*, 23|*, 24|* 


4 






12 *, 14 *, 23 *, 34 j* 


4 


(234) 




13 *, 23 *, 34 j* 


5 


(34) 




12 *, 23 *, 24 j* 


5 


(234) 


85 


13|*, 14|2, 14|23, 23|*, 34|* 


3 


(1243) 




13 *, 14 *, 23 *, 24|* 


4 






12 *, 14 *, 23 *, 34 * 


4 


(234) 




12 *, 14, 14 2, 23 *, 24 * 


38 


(13)(24) 


86 


13 *, 23 *, 24, 24 3, 34 * 


38 


(34) 




12 *, 23 *, 24 *, 34, 34 2 


38 


(234) 


87 


13|*, 14|*, 23|*, 24|*, 34|* 


2 






12 *, 23 *, 24 *, 34, 34 2 


38 


(234) 


88 


12 *, 14 *, 23 *, 34 1* 


4 


(234) 




14 *, 23, 23|4, 24|*, 34|* 


38 






-lOl -\ A 't A 1 O Art 1 rt J 1 

13 *, 14, 14 3, 23 *, 34 * 


38 


(1243) 


89 


12 *, 14 *, 23 *, 34 * 


4 


(234) 




14 *, 23, 23|4, 24|*, 34|* 


38 




90 


13|*, 23|*, 34 * 


5 


(34) 




12, 12|3, 23, 23|1, 23|4, 34, 34|2 


40 


(24) 


91 


13|*, 23|*, 34 * 


5 


(34) 




12 4, 12 34, 23, 23|4, 23|14, 34, 34|2 


10 


(14)(23) 


92 


12 *, 14 *, 23 *, 34 * 


4 


(234) 




13 *, 23 *, 34 1* 


5 


(34) 




12 *, 23 *, 24 *, 34, 34|2 


38 


(234) 


93 


13|*, 23|*, 24|1, 24|13, 34|* 


3 


(34) 




14 *, 23, 23|4, 24|*, 34|* 


38 






12 *, 23|*, 24|*, 34, 34 2 


38 


(234) 


94 


14, 14|3, 23, 23|4, 34, 34|1, 34|2 


40 






13, 13 2, 13|4, 14, 14|3, 23, 23 1 


40 


(1243) 


95 


13|*, 14|*, 23|*, 24|* 


4 






14, 14|3, 23, 23|4, 34, 34|1, 34|2 


40 
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% 


Representable decomposition of Hi 


Equivalence class 




lo|*, 14|*, Zo|*, Z4|* 


4 






1 Ola, 1 /l 1 j, OQ| j, Q/l la, 

1Z|*, J.4|#, Zo|#, o4|* 


4 


(234) 




1/lla, OQ OQl/1 O/lla, Q/lla. 

14|*, zo, zo 4j Z4|*, o4|* 


38 






lOla, IQla, 1/lla, OQ OQl1 
1Z|*, lo *, 14|* 3 Zo, Zo|l 


38 


(14)(23) 




1 Q I 1/l|j, 0°J ^ 971 la, 

lo|*, 14 *, Zo Z4|* 


4 






lz|*, 14|*, zo|*, o4|* 


4 


(234) 




1 /I I . OQ OQl A 0/1 1 Q/IIj, 

14|*, Zo, Zo|4, Z4j#, o4|* 


38 




no 


OO OOl /I O/l O/llO 

23, 23|4, 34, 34|2 


41 








41 


(243) 


99 


14|3, 14|23, 23, 23|4, 24, 24|3, 24(13 


10 


(134) 




14, 14|3, 23, 23|4, 34, 34(1, 34|2 


40 




100 


12|*, 23|*, 24|* 


5 


(234) 




12, 12|3, 12|4, 14, 14|2, 23, 23(1 


40 


(13) (24) 




12(4, 13, 13 2, 23, 23 1 


42 


(142) 


101 


13|*, 23|*, 34|* 


5 


(34) 




12 *, 23 *, 24 * 


5 


(234) 




12, 12|3, 23, 23|1, 23|4, 34, 34|2 


40 


(24) 




13, 13 2, 23, 23 1, 23 4, 24, 24 3 


40 


(243) 




£38 £10 £11 £39 £l8 




£22 £26 £41 £31 £47 



Figure A.l: Representable relations associated with acyclic digraphs. The rela- 
tions are labelled in reference to Table IA.1I 
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